iteration-saturation-small-dataset/specs-cold-btreemap/256

PDF of Slope Regression

Additional Statistics:

Lower bound Estimate Upper bound
Slope 71.983 ns 73.514 ns 75.163 ns
0.9214345 0.9354116 0.9192552
Mean 73.084 ns 74.463 ns 75.890 ns
Std. Dev. 2.5491 ns 3.6583 ns 4.4816 ns
Median 72.841 ns 74.419 ns 75.950 ns
MAD 1.4708 ns 2.3394 ns 6.2067 ns

Additional Plots:

Understanding this report:

The plot on the left displays the average time per iteration for this benchmark. The shaded region shows the estimated probabilty of an iteration taking a certain amount of time, while the line shows the mean. Click on the plot for a larger view showing the outliers.

The plot on the right shows the linear regression calculated from the measurements. Each point represents a sample, though here it shows the total time for the sample rather than time per iteration. The line is the line of best fit for these measurements.

See the documentation for more details on the additional statistics.

Change Since Previous Benchmark

Additional Statistics:

Lower bound Estimate Upper bound
Change in time +13.364% +17.051% +20.885% (p = 0.00 < 0.05)
Performance has regressed.

Understanding this report:

The plot on the left shows the probability of the function taking a certain amount of time. The red curve represents the saved measurements from the last time this benchmark was run, while the blue curve shows the measurements from this run. The lines represent the mean time per iteration. Click on the plot for a larger view.

The plot on the right shows the two regressions. Again, the red line represents the previous measurement while the blue line shows the current measurement.

See the documentation for more details on the additional statistics.